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(54) VIDEO INDEX GENERATOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To generate a video index by properly 
selecting again a representative image fetched at detection of a 
scene change. 

SOLUTION: At first, an input video image is stored in a video 
storage section 107. a scene change detection section 101 detects 
a scene change and fetches a representative image from an input 
video image at the detection and it is stored in a representative 
image storage section 1 04. Then a control section 111 gives an 
instruction to a video image reproduction section 1 08 and a video 
image before and after the scene change designated from the video 
storage section 107 is reproduced. The image with the highest value 
is selected among the reproduced video images by the operation 
and its still image is replaced and fetched from the image reception 
section 110 and the image is replaced with the representative image 
in the representative image storage section 1 04. A video index 
generating section 1 05 generates a video index from the replaced 
representative image group and a video index such as a video list is 
printed out by an index print section 1 1 3. 
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Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. )Mca|e4c shows the word which can not be translated. 
3.1n the drawings, any words are not translated 



CLAIMS 



[Claim(s)] 

[Claim 1] In the image index listing device which performs image index creation to an Image including the scene 
change whose image is the part which changes rapidly in time A means to detect a scene change, and a means to 
incorporate the static image of one or more frames at the time of detection of said scene change, A means to 
display said incorporated static image of one or more frames as a representation image. The image index listing 
device characterized by providing a means to reproduce the image before and after said scene change, a means to 
incorporate the static image of one frame in said reproduced image, and the means that replaces said incorporated 
static image of one frame with one frame of said representation image. 

[Claim 2] The means which displays the image which a means to reproduce an image while enabling selection 
actuation of a scene with the displayed representation image reproduced, and enables selection actuation of the 
static image of one frame in this image is provided. A means to reproduce said image reproduces the image before 
and after the scene change to which the representation image showing the scene chosen with the means which 
enables said selection actuation belongs. A means to Incorporate the static image of one frame in said reproduced 
image Is an Image index listing device according to claim 1 characterized by Incorporating the static Image of one 
frame chosen with the means which enables said selection actuation. 

[Claim 3] A means to reproduce the image before and after a scene change is an image index listing device 
according to claim 1 or 2 characterized by controlling a means to offer an input image from the exterior based on 
information at the event at the time of detection of a scene change, and reproducing the image before and after the 
appointed scene change. 
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http://vmw4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi.ejye?u=http%3A%2F%2Fwvm 2004/08/06 



1/3 ^—zy 



* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by connputer. So the translation may not reflect the original precisely. 
2.**^* shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] After facing using as a representation image the static image with which the hand 
incorporated the scene change in an image in the loan and rechoosing the static image of the frame of arbitration 
incorporated separately as a representation image out of an image, this invention It is a thing about the image index 
listing device which realizes the environment which can create the image index which consists of a rechosen 
representation image. It can use suitably in the wide range industrial field in connection with service using work of 
image indexes, such as image index work business, image library business, an image CD-ROM manufacture, a video 
manufacture, and electronic publishing business, and an image index. 
[0002] 

[Description of the Prior Art] In the conventional image index listing device, the static image of one frame with 
which the hand incorporated in the loan the so-called scene change whose image is the part which changes rapidly 
in time at the time of scene change detection is adopted as a representation image as it is. The contractor using 
the image index represented by image library business is examining the attempt which distributes the image property 
and the product of its company to a customer as a video list from the object advertized widely using the image 
index displayed on the display printed as hard copy. 
[0003] 

[Problem(s) to be Solved by the Invention] By the way, the representation image printed or displayed on the above- 
mentioned video list does not necessarily need to be an image at the time of scene change detection, and in the 
image which represents the whole cut rather, or a scene, the worthiest image, i.e.. they are images, such as a 
precious flash, is powerful and effective [ the image ], or it is beautiful. 

[0004] However, the index created by the above-mentioned conventional image index listing device is an image at 
the time of scene change detection, and it had become a big problem that it is not necessarily the worthiest image 
in a series of scenes. 

[0005] This invention aims at offering the image index device which realizes the environment which can create the 
image index which is to solve the trouble of the above-mentioned conventional technique, and consists of a 
rechosen worthy representation image after rechoosing the static image of the suitable frame of arbitration 
incorporated out of the image as a representation image. 
[0006] 

[Means for Solving the Problem] In the image index listing device which performs image index creation in this 
invention to an image including the scene change whose image is the part which changes rapidly in time in order to 
attain the above-mentioned object A means to detect a scene change, and a means to incorporate the static image 
of one or more frames at the time of detection of said scene change. A means to display said incorporated static 
image of one or more frames as a representation image, A means to reproduce the image before and after said 
scene change, and a means to incorporate the static image of one frame in said reproduced image. The image index 
listing device characterized by providing the means which replaces said incorporated static image of one frame with 
one frame of said representation image is used. 

[0007] In the above-mentioned image index listing device The means which displays the image which a means to 
reproduce an image while enabling selection actuation of a scene with the displayed representation image 
reproduced, and enables selection actuation of the static image of one frame in this image is provided. A means to 
reproduce said image reproduces the image before and after the scene change to which the representation image 
showing the scene chosen with the means which enables said selection actuation belongs. It is suitable for a means 
to incorporate the static image of one frame in said reproduced image to incorporate the static image of one frame 
chosen with the means which enables said selection actuation at the point which improves the operability. 
[0008] Moreover, in the above image index listing device, it is suitable for a means to reproduce the image before 
and after a scene change to control a means to offer an input image from the exterior based on information at the 
event at the time of detection of a scene change, and to reproduce the image before and after the appointed scene 
change, when simplifying the configuration of equipment. 

[0009] The modification function of a representation image is realized and it enables it to create image indexes, 
such as a video list which consists of worthiest image chosen from each scenes, in this invention by reproducing the 
image before and behind a scene change, making selectable the worthiest static image of one or more frames out of 
the playback image, incorporating the static image chosen there, and replacing with the representation image of one 
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or more frames. 
[0010] 

[Embodiment of the Invention] Below, the example of a gestalt of operation of this invention is explained in detail 
using a drawing. 

[001 1] A block diagram shows the configuration of the example of a gestalt of 1 operation of this invention to 
drawin g 1 . The example of a gestalt of this operation consists of the following each part 
[0012] (1) An input video signal and a time code are inputted into the scene change detecting-element scene 
change detecting element 101 from the exterior. In this scene change detecting element 101, if the scene change 
whose input image is the part which changes rapidly in time is monitored continuously and a scene change is 
detected, while outputting that detecting signal to the representation screen incorporation section 103, the time 
code information at that event is outputted to the scene change information storing section 102. as the detection 
approach of a scene change, it continues, for example — it is — it is — it asks for change of the approaching inter- 
frame brightness (in the case of a color image, it is each brightness of R, G, and B) by statistical processing, and 
when larger than a threshold with the value, the example it is supposed that the scene change occurred is known. 
For this reason, this scene change detecting element 101 is equipped with a means to accumulate the image of one 
or more frames to an input image. 

[0013] (2) Store the time code information from the scene change detecting element 101 in the scene change 
information storing section scene change information storing section 1 02. Furthermore, the stored time code 
information is outputted to a control section 111. 

[0014] (3) In the representation image incorporation section representation image incorporation section 103, if a 
scene change detecting signal is inputted from the scene change detecting element 101, from an input video signal, 
the representation image of one frame (you may be one or more frames) just behind that will be captured, and the 
incorporated representation image data will be outputted to the representation image storing section 1 04. for 
example. 

[0015] (4) In the representation image storing section representation image storing section 104, while storing the 
representation image data from the representation image incorporation section 1 03, when the replacement image 
data from the replacement image incorporation section 110 has been sent, replace and store representation image 
data by the replacement image data. Furthermore, the stored representation image group is outputted to the image 
index generation section 105. 

[0016] (5) In the image index generation section image index generation section 105, generate the image index which 
consists of representation image groups stored in the representation image storing section 1 04 according to the 
image index generation instruction from a control section 111, and output to a display 109 and the index printing 
section 1 1 3. 

[0017] (6) In the image incorporation section image incorporation section 106, incorporate an input video signal and 
output image data to the image storing section 107. 

[001 8] (7) Store the image data from the image incorporation section 1 06 in the image storing section image storing 
section 107. Furthermore, the stored image data are outputted to the image reproduction section 108. 
[0019] (8) In the image reproduction section image reproduction section 108, reproduce the image information 
stored in the image storing section 107 according to the image reproduction instruction from a control section 111, 
transpose to display 1 09 row, and send out to the image incorporation section 110. 

[0020] (9) Display the playback image from the image reproduction section 1 08, the image index generated in the 
image index generation section 105, a control panel, carbon button information from a control section 111. etc. in 
the display display 109. 

[0021] (10) In the replacement image incorporation section replacement image incorporation section 110, it replaces 
according to the replacement image incorporation instruction from [ out of the playback image displayed by image 
reproduction actuation ] a control section 111, capture an image, perform the replacement with the representation 
image which corresponds to the representation image storing section 104. and output the replaced new 
representation image. 

[0022] (11) while sending the scene change information stored in the image reproduction section 108 at an image 
reproduction instruction and the scene change storing section 1 02 in the control-section control section 1 1 1 
according to the actuation information from the actuation input section 112 — the replacement image incorporation 
section 110 — a representation image replacement instruction — delivery — send an image index generation 
instruction to the image index generation section 105 further. Moreover, the information on the control panel which 
is needed for actuation, a carbon button, etc. is outputted to a display 109. 

[0023] (1 2) Input actuation information into a control section 1 1 1 from input devices, such as a mouse and a 
keyboard, in the actuation input section actuation input section 112. 

[0024] (13) Print the image index generated in the image index generation section 105 in the index printing section 
index printing section 1 1 3. 

[0025] The example of the image index creation actuation screen of drawin g 2 is used for below, and the example of 
image index creation actuation is explained to it 

[0026] In drawing 2 , the playback graphic display window 202, the image index viewing window 203, the control panel 
204, and the replacement image selection carbon button 205 are displayed on Screen 201 of a display. In this 
example, the carbon button currently displayed on the control panel 204 expresses a hard flow rapid traverse, hard 
flow playback, hard flow coma delivery, a halt, forward direction coma delivery, forward direction playback, and a 
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forward direction rapid traverse with seven kinds from the left, respectively. 

[0027] First, a representation Image to change is chosen using a mouse etc. out of the image index viewing window 
203. By this actuation, playback preparations of the image stored in the image storing section 107 are made, and 
preparation of a display of the frame image corresponding to the selected representation image is made in the 
playback graphic display window 202. 

[0028] Next, if an operator chooses each carbon button of a control panel 204 with a mouse etc. and operates 
playback etc., the scene change Information stored in an image reproduction instruction and the scene change 
storing section 102 from the control section 1 1 1 will reproduce the image before and after the scene change to 
which the representation image with which Image reproduction section 1 08 HE sMc**3Me and the image reproduction 
section 108 were chosen belongs from the image storing section 107. Each frame image of the reproduced image is 
displayed on the playback graphic display window 202 on the display screen 201 of a display 109. 
[0029] Next, an operator looks for the image optimal as a representation image out of the frame image reproduced 
and displayed. By actuation of a control panel 204, the image optimal as a representation image is stopped in the 
condition of having displayed on the playback graphic display window 202, out of an image. After an operator checks 
that the image displayed on the playback graphic display window 202 is suitable as a representation image, he 
replaces with a mouse etc. and chooses the image selection carbon button 205. By this actuation, it replaces from a 
control section 111, and transposes to the image incorporation section 110, and an image incorporation instruction 
is sent, and the image captured with this instruction is replaced with a representation image, and is anew stored in 
the representation image storing section 104. Moreover, it can come, simultaneously an image index generation 
instruction is sent to the image index generation section 105, and correction of an image index is made. 
[0030] The above is explanation of the example of a gestalt of this operation. In addition, in the example of a gestalt 
of this operation, although the example replaced with the static image of one frame which captured the 
representation image was shown, replacing with the static image of two or more sheets in one scene is also 
considered. This is realizable by changing actuation procedure so that it may perform exchangeably after making the 
multiple selection of the static image to replace. 

[0031] Moreover, it is not necessary to necessarily accumulate it into equipment, and in the example of a gestalt of 
this operation, an image is once accumulated, and although the example which generates an index was shown 
reproducing the accumulated image anew, an image can control the videocassette recorder which offers an input 
image based on the time code which corresponds a representation image, and can also perform index generation. 
[0032] 

[Effect of the Invention] Since the image before and behind the scene change of the scene which was specified in 
the representation image captured by detection of a scene change according to this invention so that clearly is 
reproduced by the above explanation, a suitable image is chosen out of it and it was made to be replaced, the 
effectiveness that the activity as which a customer selects a desired Image and a desired scene from image 
property, such as an image library, becomes easy is expectable. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the example of a gestalt of 1 operation of the image index listing device 
by this invention. 

[Drawin g 2] It is drawing showing the example of the actuation screen of the image index listing device in the 
example of a gestalt of the above-mentioned implementation. 
[Description of Notations] 

101 — Scene change detecting element 

102 — Scene change information storing section 

103 — Representation image incorporation section 

1 04 — Representation image storing section 

105 — Image index generation section 

106 — Image incorporation section 

1 07 — Image storing section 

108 — Image reproduction section 

109 — Display 

110 — Replacement image incorporation section 

111 — Control section 

112 — Actuation input section 

113 — Index printing section 

201 — Display screen 

202 — Playback graphic display window 

203 — Image index viewing window 

204 — Control panel 

205 — Replacement image selection carbon button 



[Translation done.] 
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©jmi 1 i:f}>^m^mtmmL<ojh!^^i 1 o^a# 

^ >-x ■/ :7 X^SP 10 5 ^a^m-< y'r-yi' X±fSi^^ 

[0030] &±f}^^mm<^mm.mcr)mmxhh . =2: 



t oco X- yioti'-c' 2 m:j±<m3tm^ tm.%mx.hz. 

M-r S i i: tc i o THJIT'^ -S . 

[0031] ^tz. ^^<r>mmml.zi5\^x . msi^— 
m.mzmk-rhit2mi^£<. i^m^tinm^^^^M. 

$iJffllL, yf yi'X^M^'fTOZkiiX'^h, 
[0032] 

[HSOfSm^iiBB] 

[01 ] *5&BH{cJ:5i!!l(!^>f yx-y^';^.f^«5ia^^ 

[02 ] ±xsmL(mmmf.ziini>mk^ VT-y-^y^^ 

1 0 2-;^->'^x>'>'ffi#tSS^a5 

1 0 4-ft«B«tSttl35 
1 0 5- -?!fc®^ yx-y 

1 oe-iisfefiaixoii;^^; 
1 0 7-B!*;«tS*^a5 

10 8-B*«S^aJ 

1 0 

1 1 o-m.tmx.mm.*)j2>?i-^ 

1 1 2-Sf^A:'3gi5 

1 1 s-^y^-y^xmiSi 

20 I' -x-fXri^'f BM 

2 0 2-S^^^'> >- K-^ 

2 0 3 "*®'f >^'y!^X^^^yVi^ 

2 0 4-^f^>'N-;t.;l^ 

2 0 5-a#texHmSS?^:J'y 
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